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On the Solution of Linear Equations in Infinitely Many 
Variables by Successive Approximations.* 

By J. L. Walsh. 



In this paper we shall consider systems of equations of the type 

a u a 'i T a xz^2 ~r Q>is x & ~r ' ' ' == c i > 
&2V&1 "T" ^2^2 ~r &23%z "T" ' == @2 > 



(1) 



where the a*) and c» are given real or complex numbers and the Xi are to be 
determined. Systems of type (1) have been solved by various means,f in- 
cluding the method of successive approximations, but this method has been 
used chiefly for Hilbert space [i. e., the space of points {xje} for which 

00 

S I iCfc | 2 converges] with corresponding restrictions on the an and cj.J It is 

the object of the present paper to give a number of new conditions under 
which (1) can be solved by successive approximations; in particular, it is 
shown that if (1) has a non-vanishing normal determinant and if a simple 
transformation of the system is made, then the method of successive approxi- 
mations can be used. The method of successive approximations is very 
convenient for numerical computation. 

We shall use the method of successive approximations to prove the 
following theorem, which applies to a system of equations of type slightly 
less general than (1) : 

Theorem I. // there exist positive constants C, M, and P such that the 
coefficients of the system 



x x + a^Xz + fi^s + • • • = c x , 

X% -\~ ^23^3 -p ' " * == C 2 , 

x$ -\- ' ' == c 3 , 



(2) 



satisfy the restrictions 

* Presented to the American Mathematical Society (Chicago), Apr. 7, 1917. 

fSee, e. g., F. Riesz, Equations LmSaAres. 

J See E. Goldschmidt, Wttrztrarg Dissertation (1912). 
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I Cfc | 2j 3/C 1 ', 2 | a k i | convergent (fc = 1, 2, • • •)> 2 | a^ | ^ P /or every 

k > K, < (1/P), C^ 1, Men (2) has one solution and only one solution 
for which \ Xu | ^ /*/', y < (1/P), y = 1- 

We first consider the special case K — 0, and we take for approxi- 
mations 



*<»-<*. (*-l, 2, • • •), 



r (t+D 



Cfc- 



K^' 1 , + a***"' + • • (i = 1, 2, • • ) 



} 



(3) 



From (3) it follows that 



s-=c*, 



X k 



.3.(1). 
. 3-(2)- 






•], 



and therefore 



(4) 



(5) 

(6) 



< < IfC* + PMC** 1 + P 2 MC k * 2 + ■ • • = ilf C*/(l — PC) . 

The Xk as defined by (5) are a solution of (2), for if we add all the equations 
of (4) and sum by columns the resulting absolutely convergent double series, 
we have 

Xk = Ck — [akk tl Xk t i + akk+ 2 Xk t2 + ' ' ']• 

By (6) we see that for the Xk defined by (5) there exist m and y such 
that | Xk | ^ /*y*, y < (1/P)> y= !• Under this restriction the solution is 
unique, for if x/ and Xk" denote two solutions satisfying this restriction, their 
difference x k = Xk — Xi" is a solution of the homogeneous system corres- 
ponding to (2) : 



(?) 





x x -\- a 12 x 2 -j- o. l3 x 3 -\- ■ 


•-o, 




x 2 -j- a 23 x 3 -\- • 


•-0, 




^3 + - 


• = 0, 


and we have 




9 



Place 



\x k \^NX k , Z<(l/P), X^l. 



z< l >=% (fc = l, 2, ■ ■ ■), 

a; (i + i> == _ [a k k^ 1 + a** t2 z«> 2 + • • (t= 1, 2, • • •)• 
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from which it follows that | z* (ltl) | ^ P*NX**. Hence 
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limxit (1) = 0. 

i=O0 

But we have Xk w = Xk a) = x k by equations (7). Hence Xk = 0, which 
proves the uniqueness of the solution and completes the proof of Theorem I 
for the case K = 0. The reader will easily complete the proof of Theorem I 
in its generality [K =/= 0] by the use of mathematical induction. In this 
proof, it will appear that equations (3) and (5) will give Xk for every 
value of Tc. 

When the Xk defined by (3) and (5) are computed in terms of the ai} 
and ct, it is found that 



X no 00 

Xk = Ck — 2 OkjCj +22 akjand — 



(8) 



which is the so-called Neumann series. 

The following special case of Theorem I will be used in the sequel : 



ou 

Theorem II. If for the system (2) we have 2 | auj \ convergent for 
every Tc, 2 | a*/ | ^ P < 1 for every Jc > E, 

)-k+l 

I Ck | ^ C for every k, 

then {%) has one solution and only one solution for which the Xk are bounded. 
Moreover, this solution is given by the Neumann series (8).* 

We now return to the system of general type (1), and shall proceed to 
show that if (1) has a non-vanishing normal determinant and if the Ck are 
bounded, then (1) can be transformed into an equivalent system of type (2). 
This latter system will be shown to satisfy the hypotheses of Theorem II, 
and therefore the method of successive approximations can be used. To show 
the possibility of making this transformation we need the 

Lemma. In any non-vanishing determinant 



A<*> 





On a i2 ■ 


• • o lfc 


— 


a 21 « 2 2 


• a 2 k 




OA-J Uk 2 • 


• akk 



* Theorem II is similar to a theorem given by von Koch, Jahresiericht, 1913, 
p. 289. 

2 
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the rows can be arranged so that no minor 



A (<) 



fl U a i2 ' ' ' <M 
$21 ^22 *^2^ 



an a< 2 



ffii 



(t-1, 2, 



fc) 



win vanish. 



This lemma is evidently true (although trivial) for fc = 1 and fc = 2; 
the reader can readily complete the proof by induction. 

We have supposed (1) to have a non- vanishing normal determinant; 

00 

that is, we suppose 2 | aij — d if | to be convergent [da is the Kronecker 
symbol whose value is zero or unity according as i =^= j or i = /] and 

lim A<*» = A ^ 0. 



Then there exists k such that A <n ' =^= for «. = k, k + 1, • • • . Hence, by 
the Lemma, the order of the equations can be changed (if necessary) so that 
A <n) =7^= for n = 1, 2, • • • . Such rearrangement will not affect the con- 

00 

vergence of the double series 2 | «</ — da\ nor the value of A. 

i, i=i 

We suppose, now, that this arrangement has been made, and we proceed 
to transform (1) into an equivalent system of the type 



b ll x l + b 12 x 2 + 6 13 :r 3 + • • • = ft , 

2 2 X 2 "T "23 3 '3 "T ' * ' = ft J 
"SS-^S 1 ' ' " == ft > 



(9) 



This transformation is made by placing* & 1 n ; = a 1 fc, ft = c„ and for n >1, 

*U °12 ' * * °1. »-l a i* 



6n. ft = 



ft = 



ffiiii <In2 ' ' ' *». "-1 ®*. * 
fl ll °12 '''*!. »-l C l 



, (1-1, 2, • • •) 



C^ni &n2 * * * On, n-\ Cn 

The ft as thus denned are bounded for if we set 



* Riesz, I. c, p. 11. 
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00 00 

4t — aid*— d ik \, n = n(i + Aic), 



we shall have 

| /?„ | = absolute value of 

where | c fc | g C (ft = 1, 2, • • •)• 



flii! CUj ' 0>n, n-i Cn 



^n-c, (io) 



Similarly, we shall prove that 2 | bn | converges for every t. For by 
using a method similar to that used in (10), it follows that for n < k, 



&»*|^n[|a lfc | + |a 2 *|+ • • • +|ort|]. 



Hence we have 

I K n tl | + | K » + 2 I + • • • 

^ n [ I oj. „ +1 1 + 1 o,. „ +2 1 + • • • 

+ I <h. « + l I + \<h. n +2 | + * * * 

+ I «n, n« | + | On. n +2 | + - ' • ] • 

Then for every value of n, the series of absolute values of the coefficients 
bnky ft > n, converges; and its sum approaches zero as n becomes infinite. 

None of the bnn is zero and they approach a limit different from zero, 
so when we write system (9) in the form (2) the hypothesis of Theorem II 
is satisfied. Therefore we have shown that if (1) has a non-vanishing normal 
determinant and the c< are bounded, and if (1) is transformed into an 
equivalent system of type (2), then the method of successive approximations 
can be used. Incidentally we have proved the theorem of von Koch that if 
(1) has a non-vanishing normal determinant and if the d are bounded, then 
(1) has one solution and only one solution such that the xt are bounded. 

We shall now state two theorems, each of which is proved precisely as 
Theorem I was proved. The a% of each theorem are given by the Neumann 
series (8). 

00 

Theorem III. // system (2) is such that 2 | a*/ \" (p > 1) converges 

j=k+l 

oo 

for every ft, 2 | ai-y | p ^ Q v for every ft > K, 

\c k \fkMC*, C< (1 + ^ /(p , 1))(p , 1)/p 
then (2) has one solution and only one solution for which 
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I x * I = Mr> y < (J _j_ Qp/(p-i)yp-D/p- 

Theorem IV. Under the restrictions | a (k | ^ NT*-* for every k > i, 

|ft|^3fO», rc<i/(i + #), 
system (2) to one solution and only one solution for which 

|**|^/V, Ty<l/(l+^).t 

Madison, Wis. 
June, 1917. 



* A slightly less general theorem for the case p = 2 was proved by von Koch using 
infinite determinants. See Proc. Camb. Cong. Math. (1912) I, p. 354. 

In proving Theorem III there will be found useful the following inequality duo 
to Holder: 

OC 30 00 t 

j 2 a k 6* |" ^ (2 | a* |") (S j & fc l^ 1 )^ 1 . 

See Riesz, 2. c, p. 45. 

t Cf. von Koch, I. c, p. 355. 



